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blueprint^ the 
has undertaken 



Dsing a "Knowledge .Development Plan" prepared as a 
Office of YQu^th Prcgsam's of thfe Department of La;bor 
various demoiTstration projects and l^rge-scale 
evaluation and^^complementary research studies. The Office is 
experimenting with alternative employment, and employability 
development approaches for economically disadvantaged youths in and 
cut//if sch.Qol. One, of the first objectives of the knowledge 
development activities was to develop a standard set of assessment 
measures and thereby establish a uniform data base across a wide . 
rariety of program strategies being tested. Baseline data have 
provided insight into important relationships between school ^nd 
■working. .The findin^g that the skills^ competencies^ and behaviors 
that constit-ute employahility are acquired incrementally has led to 
the notion of benchmarking'^ If acquisition of employment-related 
attributes is sequential^ then prograjn structure must be sequential. . 
Eesearch is feeing directed to gaining insights into '.structuring 
elements in prograins' such as Oomprehensive Employment and Training ' 
Act (CETA) programs. Other focuses "Ire gaining private sector access^ 
testing .^of alternative work-oriented programs to prevent dropping Out 
and provide incentive for^-eturn to school^ linkages between CETA and 
local educational agencies^ and institutional change that Youth 
.Eniplcyment and Demonstration^Proiects Act (YEDPA) legislat;j.on can 
bring about, (Questions a-nd answers are appiended.) (YLB) 
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THE NATION^ CENTER MISSION STATEMENT 

X r ' ' 

The National Center-for Research in VJcationaUEdurfation's mission 
IS to increase the ability of diverse agencies, institutions, and organi- 
zations to-solve educational problems relating to individual career 
planning, preparation, and progression. The National Center fulfil Is 
Its mission by: /— ^ ; '"'^ 

" ' ' Ty^- ' " ■ ' ' i^f-? 

* Generating.knowledge thrdugh research ■rW^^^fr' ' 

* Developing eduQational programs and products/^^ - ' 
. . * Evaluating individual progVgm heeds and butcbmes/ / 

/ . * Installing educational^rogran>s and products V 

•.Operating information systems and Services ' 
J • Conducting leadership development and^raininc - rograms 



PREFACE 



t Ope of the greatest economic and sociaJ problems facing ^is todayis the problem of youth 
employment. How dp we tnalte sure our young people have the training and skills necessary to find 
and keep a full-timejob after they finish their schooling? How do. we deal with the numbers of * 
young people who drop out of school ill-equipped to enter the worlcJ of work? V 

Several strategies have been developed a^ the federal Jevel in response to th§se problems. The 
Department^f Labor has been one of the'^key governmental agencies responsible for much of the • 
activity m this area, and a great deal of federal money has been entrusted to this department to 
.develop program? to make y^uth employable and to find them jobs. Here to speak' with us on the 
topic of youth employment and the plans being developed by the Department of Labor to deal with- 
youth issues is Evelyti Ganzglass, special assistant jto the administrator of the Office of Youth Pro- 
grams for Education Affairs.^ v"' 



IVIs, Ganzglass holds aTbachelor's degree tn political scienpe.ffom the University of Pennsylvania. 
She has Worked forl<Te.Department of Labor in|mployment ai^cl training programs for the past 
fifteen years at bofh the natioaal and regional levels. Within'the Office of Youth Programs her primary 
responsibilities relate to improving CETA/education collaborations at^all levels— federal; state, and 
local. In addition, she'^has responsibilities in a variety of special programs concerned with fmproving ^ 
linkages between tHe?^ worlds o^f ^e^ucation cirid work. She al^o works clo$ely with projects that provide 
qajeer information to 7ou1feh.*^ ^ ^ .. ' , v. 



On behalf of. the National Xpenter for Research in Vocational Education and The Ohio State 
University^ I arti especial l^appy tq welcofne Evelyn Ganzglass and to share with you her speech 
entitled, "Thd KriowledgelDev'elopment Plan of the Oifice of Youth Programs: Implications for 
Vocational "Education Re'search and 
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THE KNOWLEDGE DEVELOPMENT PLAKi * 
HE OFFIGE OF YOUTH PROGRAMS: 

IMPLidATIONS F^^ EDUCATION- 
i RESEARCH AND DEVELOPMENT ^ 




IntrpductionV . • Y:. 

I had great trepedations ip accepting, your invitation to address this distinguished group of 
scholars because!! am not personally involved in conducting research on vocational education or even 

; CETA. Essentially, I am a policy analyst with a very programmatic bent. I tend to ask what services ^ 
r^ke a difference? Why? How can we-nnost effectively deliver these services yvith in the constraints^ of - 

/ fegislative authority, fur)dihg availability, and the ability of institutions \o provide the services needed? 

V ^ eager to use research findings if they are understandable, relevant, and timely for my 
decision-making concerns. As you are all too well^aware, much of the research that is produced often ^ • 
I is not adequately used because^ one of these elements is missing. The fault lies both with the policy 
maker who does npt adequately articulate his or her information needs and the researcher who does 
not devote enough /Attention to the issue of utilization. i^ -- 

- . For the p^st'tWo arid a half years, a/c- n the Departrrfent of L^or's Office of Youth Pfogr- 
nave been in therfenviable position of hcv;--: an unprecedented halfTbillibn dollars of discretic ~. 
money available/for a rarige^f research ^er onstration, and evaluation activities designed to ae 
knowledge ori v^hich to base decisions fgai^ing yoCith policy for the 1980s.. 



:p 



For the Department of Lal;)or, " 
'from school to Work . The fact is tb^ 
highest school Jropt „r rate and ter . 
cern lies with provic 
^nd other preparatic^ 
should be given to pr-oviding^such 
school prbgr^am. To answer thisqL • 
• such a cofpponent increases the stv 
success of disadvantaged /cuth. 



• eccinomiCc 
teadin^g to er 



-uth 



Ti line is employment— helping youth rhakiB .ne : 
'om families with the lowest income tend tc hav^- ' 
:n urfemployed after leaving school. Our oven-idina 
ntaged youth with the opportunity^for work exp-r 
The key policy question is whether nationa pr s'- 
a subsidized work componerit as part of tht.:; secc 
nust rely ori research to provide insight into wh 
:n rate and p^stschool.employment and earning. 



nsiticiv 

con- 
fence 



Using a "Knowlec.ie I-ive vomer 
,we have undertaken a iruc:ure\: arfav ~ 
and complementary. rc.:^-:rcr snudie^X ;.:r;< 
development approacr rv: for : -lor omirxii! 
the vast majority of researcr not n' : ::: 
My intention today i: tc r wOi t to ^ jr 
additional informaticr. as 'l^I j:e: 



:'::::ared in advance of each fiscal year asal}|'jer?nnt. 
; 1.0 demonstration projects and large-seal lev v^** 
- 3n ' with alternative employment and errolc abir 
r rvantaged youth who are in and out of scnoc, , A; 
ate, we are beginning to get a return on our* in estr 
plans, sortr^ early findings, and expectaticns it. 
rilications for further research and follow-:hrr 



EKLC 



^ - Compion Measures '* 

■ ■ • V : ' V. -. . ■ ■■ ■■■■ ■ /■' 

On^f the first objectives of our knowledge developmentactivitieswas to develop a standard / 
set of assessment measures and thereby establish>crnifdrm data base across a wide variety of program ■ 
strategies being tested. This^ommon data base is essential if/any aeneralizations are to be made about ■ 
program impact across sites and service deliverers. The approach taken by the Office of Youth Programs 
m measuring program effectiveness and impact has be^ td focus primarily^on behavioral-changes in , 
career-related skills and \Aocational adjustments evidencejl by student participants. These have been 
assessed in two ways: first, in terms of gain scores in job-ieeking and job-holding skills, self-esteem 
sex bias toward occupations, and other vocational- and work-related ^titudes; and secondly in terms 
of successes such as motivation to lool%or and hold a job, on-the-job sUccess, satisfaction after place^ 
ment, and general social adjustment. Sincfe postprogram follow-up is reqiWd at three and eight nTonths 
It IS tob early to report such outcome finliings. However, we have Verified that, because of matching ' ' 
and random assignn^ent procedures, the experimental and comparison-or control groups are comparable 
on our baseline assessment measures. " , , .~ 

f, - • ■ 
The data base thus created will ppcJvide ari unparalleled source for future study of work-related 
characteristics of the unemployed^yc^th population:and wil/^rovide policy makers with an improved 
understanding of proaram design ojftions. ' -' • 7 ' 

■ ■ . ■ . • < ■ . . • , . 

Baseline Data - , : ' 

Since the passage of YEDPAl^we have gained consider'abl^ore insight into the >a ^ 
youth ertiployment. We have learned that, given an opportunity, youth do want to w 
seen t^iat there is no Dn^^outh employjuent problem but an interrelated set of prob lan lur 
hedevelc-n^p- '"^ansition process which occurs for almost everyone from ac r-n 
yenxy-o - , oserved that4he-most severe' problems are focused on only a ^ a i j:1y rr^ji 

umoer c tor ,i:;5ually inner city) youth who ireem to be.permanentiy excluae rm laiDn* .zrce 
carticipntiir" v-r-n ^iles:.' of economic activity. Baseline data collected as part of the : l- r ;nc5 
rrnti-rlene' - '-^m orovides insight into^everal important relationships^between . anc ; ng: 

^ ' --oUment and labor force activity are jointly determined. 



4 



: iiment and employment are negatively related, suggesting that ol and v.' r-; 

Jies rather than complements. 

' - ./■'■• ' ■ / ^ " 

f osjtive relationship between school-year enrollment and summe: :)iployme- 

' " ■ --^ ■ 

' ^cai 3l grade attainment increases, the number of- those who are neither empJoy ed 

■ ^nroli j ;n scnool drops steadily. ...» 

/ ,:?nal inf ^ nation will be available from three separate longitudinal data banks: the 
' .ongituciinal Manpower'Survey, based on U.S. Bureau of the Census data; the National 

' ^.onc . J iUrvey housed here at The Ohio State University; and the Standard. Assessrnont System, 

cevc f : i:-=cifical} for YE DPA programs and referred to earlier. 



Benchmarking ' • ' 

_ ' . , ♦ . . ' ■■■ ' . • ~ 

These and otherTecent 'studies df patterns of youth employment and of the career development 
process Itself have pointed out that the skills, competencies, and behaviors,that constitute employ- 
ability ar? acquired over a period of time^anning the adolescent and early adult ye^rs. Especially for 
disadvantaged youth, the ultimate goal ofemployment is reached incpemenially, lAany disjunctur.e 
often prevent attainment^of permanent employment thatoffers opportunities for career advancement. 
Assuming there is a hierarchy of competencies and intervention strategies'that help youth aevelop . 
these competencies, and assuming we learn to measure these competencies and thereby develop a 
methodology to determirl^ who is ready 'to benefit from each tytoe of Fxperier - ow can we structure 
activities to help individuals progress from one step of emcic yaHh^^ c jve co ne o tr next^ ' 




The notion of benchmarking such competency .acquisi::lon makes sense in ore r to usr CETA 
programs as a provipg ground for disadvantaged.youth, to daciimen: the ir at iiities . id at . inment:^ 
and to pr(^vide reference points for ti^e prescription and secuer • servic for • iivic. 3 F j 
sets of career development benchmarks have been recommenr ,:a. . , 7?^- ^rk •pf'^v 
ability skills or world-of-work awareness; (2) benchmarks o ork - ./ 
to arrive rr ady for work on time and maintain continui^v' ^-j. ;yf ^tl • ,5 ; - n~ 

. education; ^competencies needed to learn on the job;a ij oenchmari;: -.21 r.;:-- rli zJes. 

..^j-.:: work has been done in developing ccmpetencv standards: . - asurerier /'eyi--es 

" ' ' \/ocational skill competencies. The sta-e 0-' tr • art is r... a.- ohisdcaiec -.' en 

:orr2s .inc and measuring employability arid work nratL ty skil 3. ^: -I research ir 

rusarea rj ^ applicability to participant trackir g and pre : -am me^suTr v ithin CE"^ 

^ --^^ as if.; ims with employability developmeni: objectiv-^. 

. - ^ . \ , ^ ■ 

Sequencing 

: search questibn is a direct follow-^o to the previou 5 one a n- i act, a var-iarr.; 

of ^'^^ '^hat works best, for whorn, aed under which circumstance sg^: c f questioriii. 

acquis y. imployment<elated attributes is sequential, then pre jram stTL rrur:, 100, can be t-ouciht 
of in s- Jl^u terms, ' >' 

We observe that those youth vvho do well in Job, Corps are usually the'nore mature ones who are 
ready to devote themselves to the rigors pf the Job Corps, CETA prime sponsors ^aditidnally reserve 
on-the-job and specific occupational training for -the more job-jeady. Vocational e iucation at the post^ 
secondary level is.often viewed as being more successful tharf that at the secc mCh level, Prpsumably, 
some of this differential can be attributed to the readiness of participants to fulJy benefit frc^ the 
program. ^ ' 

Hov^ can activities be seqgenced so that one builds on another, and youth are helped to progress 
to the best of their abilities? To answer this question, we first need to betl>3r underotand the dynamtcs 
of the. various service activities that are the stock arfd trade pfmost CETA, vocational, and other 
career-oriented' programs. Thesejnclude assessment, counseling* skill training, wo-k experience, and 
vocational exploration, among others. In this context, one could address the quenion o| the compara- . 
tive effectiveness of activities ainried at developing^ehnployability versus those concerned with 
job ehtry skills. . ' 



Much (5{ cfur knowledge developmsnt actKity has been devoted to gaining just such InsigFits 
into how program eienients can be appropriately structured to meet indjviduai-client needs. For • 
instance, under the auspices o- the National.-Occupational Information Coorjdinating,Committee 
(NOICC), an in-depth study is being conducted of how qareer information services are being delivered 
within schools and with what mpact on in^oroving yputh'^ transition from- school to work. 



• Similar cross-cuttinc 
oriented edocational pre is 

. programs and program e ementi .a^^ . 

cably can be combined ard rr.:.:, lUi ' v. 
one is serious about developir/ij, on : -er 
research needs to focus more c leniic- 
leads- into another, and on whc ■ kindi 
move from oneito another. 



. -^rd's 10 be directed at t e 
orw o develop a,frarne'. ./:. > 
^■^ explored. yi<e ind!;i/idu 
1 'v. th others in a seau. i'^ 
::ompr^hensivVc:r)n ■ : 



the interrelation 
:ransition mecha 



ious compensator' zmd career- 
n wNcb the relati: ::nip between 
activities, these pre yrams prfesum- 
al and complementar y manner. If 
::.ches to employabiliry (^evelopment. 



Such analysis needs to t 
Basic QpportuajTy Grant Procr 
"programs {Upwdrd;Bound, Ta^ 
CETA, and numerous otherr 



■■A 



*ne regar-dicig financiaPsuc^::::!'! urograms' such a: 
yanc CETA as^well as p-™-- support activiti; 
Search, Folfow Through -c : tional education 



:j cf programs, on how one program 
"ns can be effectiv e in h.-jiping people 

■ V 

" k-study, t/ie 
,w oh as the trio 
cc ;9er education. 



-iirther, we need to look ~: Vv 



To carry^thife point or-.-:, 
to deliver differerlt kinds c 

vvhart is the appropriate m' \z scpooi, employers, family, :nL 
nity organizations? Can s: r-;e o f t|e special services to aid i: 
to work be more dffectivf orovicied tc youth by having c rr 
cooperatively with! the scr . :!s cpmpa?i=d to relying tota y ^ 



:h institutions are most a^ropriate 
at- cifferenl stages in t^e y ith's.developmen.! For instance, ^ 

:i, and other'vauth-s'f.Tving commu- 
in making the tranisi-lon from school 
nity-lpased organizations work 
school personnel? 



Private Sector Access . ' . ^ • , 

1 ' * . , ' * ♦ 

Considerable'aittentioniwithin 6ur knowledge development plans has been devoted to gaining . . v 
greater access to private sector worklsiTes, f indin^'support for youth employment and training .. 
programs, and studying the com^araiive advantage of ^public versus private sectem work experiences > 
for youth. It- is too early to.araw souhd conclusions about. the qualitative differences betweep the ^ ^/ 
two,'Dut indications are that private Rector errjployers arfe/much less likely tp tolerate poor performers 
on the job than are public sector emp|oyers. Also, because of the- generally sma^er^riumber^ of youth 
at private sector worl^sites, the quaMtV of the work exf>erience may be better. ^ 

A number of studies hav6 also found that it takes considerably more effort to develop work y 



/^sites in the private than publiclsector' 
served and the type*pflexperierice- that 
whether the transitions ansubsidiz 
encing subsidized work! fn the private % 
three-month ToMow-up pf, paftiqipantsli 



rhiere is a trade-off between the number of youth* vyho can be 
::an be offered. We are juat beginning to assemble data on 
prrrployment and related^earnings i's better for youth experi- 
Ictor. By next summer; we will have inforrnation b^s.ed on a 



Recognizing the in^portancfe pf \r\\ 
competency standards'fpr erhpldymem 
work experience, continuing attention rjie 
aimed at jmprovrng program success in 
the appropriate incerrtives and support 
models'might be developed ^h'iat address 



lying the'private,sector| in planning programs, developing' 
l^ted skills, and providing opporturritiesrfor private sector 
ledslo be directed at, research and demonstration efforts 
s ^ea. Program models might tJe'developednhat provide 
chanisTns to attract employer participation. Additional 
e development of entrepreneurial sifil Is a>mong youth. 



ERIC 
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Alternative Education 

One of the major assumptions being tested. under the Youth Incentive Entitlement Pilot Projects 
(YIEPP), as well as other demonstration projects, is that alternative lA/ork-oriented programs can 
*l>revent yoc*th^who are in school from droppJing out and provide Incentfves fpr those vyho are out of 
school to return. Mo^t -youth served thus far under YIEPP have been potential dropouts still in school 
artd no\ youth already outside the system who may b^ brought back through guaranteed'employiVient 
and other program benefits. * . 

^ ^ [t is. too early to^tell what the long-term impacts of such a \gb guarantee may be on school 
retention patterns. Some impact data will become available during^the spring of 1980. Our experience 
thus far has, however, clearly illustrated that youth will usually not return to traditional school settings 
once they have decided^to feave. We are currently conducting structured experi.m^nts testing various 
•alternative education approaches operated- directly within the school system as well as outsTde through 
commuhity-ba^d and other organization?. Amojiig these is a rqplicatiofjof the Career lntern~Program, 
a;fully validate^lternative education program noDdel originally developed by the Opportunities. 
Induatrializatio/i Centers of ^^America (OIC) under^e contract to the National Institute of EdMcatK)n. 
We are testing the replicability of the model as we'll as the chnsediuences of segregating high-risk yobth 
in such alternative programs as opposed to addressing their unique problems in settings with other, 
'^lionproblem" youth. ^ 



• In order to improve tbe quality of these services and to assist youth in gaining the necessary • 
Credentialsfor 6hiaimng employment. Congress required the secretary of labor- and the secretary of ' 
Health,. Education, and Welfare "to make suitabfe arrangements with appropriate state and local 
.education africials whereby academic credit may be awarded, consistent with applicable state law, . 
by educational ins^rfutions and agencies-for competenci^ derived from work experience obtairaed 
Jhrgugh programs established uiider youth employ me;?rtdemons^tration programs.'^' To date, no' 
thorough analysis has been nrade fegardirfg.the a(5Dpdpriateness of standards developed- for granting — 
e^cational credit for work experience and other career-related .courses, nor is anything khqwn about 
the consistency ot criteria developed in states and localities^hroughout the country. . 

Although there has been much d^ussion about t[ae quality of staff* in nonschogl-based alternative 
education programs, little data exists on the academic preparation and pVc^ssional experience of such 
staff. Sinew larly, little if any information is^ available on tf^d level of expertise scho^l.^/soni'iel have in 
ma nagging and teaching^in alternative programs. Experience from our dem^Qnstration^projects and the 
.National Institute of Education's w'ork wjth the Experienced-Based Career Education Program (EBCe] 
, point to the need for cons'iderable^^taff devejopment and inseryice training. EBCE and ojher projects, 
including one corhpleted here at Ohio^State, have explored and dealt witK issues r^Jated to the success- 
ful operation of 'such programs. IVj^e work is needed. The field is ripe for additional research, demon- 
straiupfi, replication, and tfesting^el^^ - 

J. . " ^* ■ CETA-LEA delations ' . . 

^* . . ■ - 

' Experience vyith the CETA-LEA linkage provisions under YETP has shown tfciat institutional , . " 
relationships are generally better irt places where communication and particularly viable.working 
relationships existed before. It is assumed that gdbd personal relati'onships among staff^rTd a-fami|i- ' 
arity with program jbperations,.procedures, and the like create ^ better environment in which produc- 
tive relationships can flourish.. * • "^C ' " • ^ ^ 
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The Council of tPiC^reat City. Schools pointed out in its report to DOL on CETA-LEA relation- 
ships injts twenty-eight-member school districts that while local collaboration efforts between schools 
and.CETA are still rare, urban YETP programs tenji, on the whole, to- be independently operated ^ 
The Council lound that "where city and school staff turnover is low, institutional alliances,-developed 
to implement prior federal youth employment initiatives, may form the basis for the new YEDPA 
programming efforts.''^ They also found that curriculum innovations newHy developed under the 
YETP were likely to be institutionalized if regular school te^chmg staff were involved. 

. . ^ » ' 

This is consistent with ^ther observations that activities established under CETA-LEA agree- 
mentsare generally better accepted vyithij the school system if they^re perceived to-fit within the 
legitimate scope of school activities. Legitimacy can be achieved by gaining the approval 'of school ; - 
leatiershipand often by establishing new activities within the framework pf accepted educational ' - 
practice. Thus, a huilnber of exemplary CETA ihsehool programs are in 'fact adaptations of validated 
• educational program models such as experienceti-based career education or vocational education. 

Conserva, Inc., a research firm under contract to the Office of Education, DHEW,*artd others 
who have studied CETA-education linkages resulting from the 22 percent set-aside provision under 
YETP, have commented that in many cases, YETP inschool programs are operated in a pVoject mode 
outside the traditional institutioj^ai^rame.wdrk of either CETA or the schools. Where^more than one 
LEA is invplved, schopis compete witlVother potential deliverers of service as well as among themselves 
for their share of the available resources. Given the^uncertainty oi annual funding, schools are often 
reluctant to include CETA programs in their long-term program and^dministrative plans. Such arrange- 
mehts, they point out, may be expedient because they permit rapid program implementation in a * 
^ manner responsive to specific programmatic requirerr^nts. They do notThowever, bring about real or 
lasting changp in the relationship between schools and CETA. ' 

Institutional Change , ' ' 

Can the short duration YEDPA legislation bring about Jasting change?- Can ^tivities targeted 
on a relatively small portion of the total school populatior/be a wecjge for change within a-total 
system? We don't know. As part of our planning charter in 1977, we said that the key purpose of 
the Youth Employment Demonstration Projects Act was to develop knowledge and not to bring about 
\ institutional change. Yet the new arrangements mandated by law.and the vast amount of discretionary 
resources pumped into the system f6r knowledge development have, in fact, set in motion significant 
change^ in attitudes'and awareness among institutions regarding the problems and potential solutions 
to youth unemploym^ent and employabllity development. i 

We have used discretionary funds to provide financial ijjicentives and rewards for both tite CETA 
and education systems for undertaking joint programs related to counselingand job-seeking skills, 
*^ private sector involvement, programs that provide for academic ccedit; and youth involvqment in 
program operations. We have highlighted programs for handicapped and^highfisTc youth as well as 
/those that specifically link CETA to educatibrtal progranns. We are testinjj and documenting the effec- 
tiveness of a wide rang^f intervention strategies and program delivery options. 



■1 ' \ ' ^ 

" Youth and Traimng Programs and the Urban SchobI: Profiles and Commentary (Council of the Great City Schools 
1 979) f p. 68. . " ' ' 



^ Dop/this strategy bring about change? What is needed to sustain interest and foster willingness 
^o-confider new ways of dq1ng the business of human development? Some would argue that regulatory 
prescri^on is needed; others, lhat incentive funding will inspire those.willing and able to change 
The str^egies undoubtedly must take into account what can be accomplished from the federal level 
fronathestate level, and from the local level to involve the many constituencies associated with this' ' 
field. 

. .... " ' ■ ' ' . ■ , • 

Capacity Building ^ / ' 

-Wh^her or not we agree that niajor ehange is needed, we can, I believe, agree that both the' 
... educationVand employment training systems need to improve their capacity to carry out their respon-*- 
. sibilities. IS important that the lessons learned under YEDPA and elsewhere be incorporated in 

program planning ar^d operations at the federal, state, and local levels. This requires synthesis dissemi- ' 
■ nation,.and application of what we know. It means that research findings must be translated into usable 
- forms for program and staff improvement as well as for policy and legislative development. There is no 

greater challenge to the research community. / / , 



/ 
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^ QUESTIONS AND ANSWERS \ 

Questidn: The evaluations we have for certain programs (Headstart, for example) show that the 
data havenn'really^iven much knowledge of what works, for what kinds of people, " 
at what poirit in the development process. Wo^ld you commit on this in terms of " 
yogr own evaluation studies? * ' \ 

Well, J agree. B.ut in our programs, in adcfixion to the preimposed testing, we are using seven 
different instruments to measure ^nificant changes.' These include a narrative descrif5tion and 
inquiries to'the participants on sucH^things as what made sense in their program, what the "important 
parts" were/ and careful documenrtatibn of the activities. We have a , whole range of these; We^are- . 
, al^o focusing^)^hoct duration kinds of activities. These might be one or two hours a week oyer a ' • 

period of orflyj^w weeks. On these Icinds of short duration a^kivities, v/e may riot find any signifi- > - 
^ cant changes, h^^^er^fs still ;the desire to get a 'fix on where thef youtfa are who are going into 
^ different kinds of programs. We need more ^nd better feeclb^cJ^n whicHkinds of youth do better 
in which kinds ofjnterventions. We are trying to track variatipns on the same type of intervention 
strategy to see if we can attribute any.differences to such factors as who the program deliverers or . 
, other ktjown variations perhaps in ^proach or community involvefrient. * t - 

' . I hav^ asked many of the same kinds of questions about the programs that have been underway 
. fop some time; I think there are trfemendous variations annong pro^ams:tin. content," in focus, in ' . 
, target fitopulations, in pbjectives, in ^e way they are being delivered. I have wondered myself how ^ 
we are ever going to be able to evaluate them. But yet, for.the first lime (at \east in th& newer programs 
t^e wilj have consistent data^ among the various programs/Up*until now we have not evepr had that— in 
?^afiy;filDrm. You can looJ< at a lot of the evaluation data from;the l'960^ fjom all the Of/ice of Education 
pcograms, the Department.of .Labor and fiEW programs, ai^d you can't compare any of it because the 
ipformation is all coming from different directions. ^^^on't even have comparable data sets, so this 
' is an attenipt to at least break through that; but how success^ol our efforts will b,e,'l personally cannot 
( address. ^ J > ' -----y ' • . > ■ 

^e^tion: ^o wh:at degree would definitions or terminology in thatapproac(3 square with those, ' • 
say, in the^^ocational Education Data System (VEDS)? Would we have comfDarability 
' of data or deffriitions'befween your research and vocational education? 

I don't know, but i doubt it. Dur instruments (the seven I referred to earlier that were being 
used originally) were developed b^^ically to capture attitude and knowledge changes and are not 
necessarily related to anything that would be iVi VEDS, We're attempting to measure suc^/things a$ 

; self-esteem ; ability of young people to think about themselves in terms oiJhe world of worK, and 
similar factors having to da with attitude or ayvareness. A large number ^ these instruments came 
from' the Educational Testinc Service in. Princeton, and at the moment the whole exercise is being ^ 
housga there, but qtheninsT . -ents are also being used. All of ^he regular CETA youth repotrting is 
included in this data set, but tra^extentto which CETA and VEDS have been made comg3rable, again, 

^ ( cannot speak to that. I kndVv there are efforts in that direction, but i don't knovy what the specie 




^ problems are in relating CETA^repor^ing to VEDS. We wi/l^e the^earrative assessment of the 
'. participants, of the teachers, Ind^he other people involve^us all the other kinds of evalU^tions* 
^being don^e. We will have the processed documentation of what is taking place in those programs so 
we will havfe mpre than we had before, but I am sure we witl by no means end up with a perfect system. 

Question: What is being done in the way of deveioping more viable or meaningful follow-up ' 
information? ^ . . , 



All- of the demonstration projects involved in this series,(and I think there are eighty some * 'X 
prpjectsl-as well as many of the other demonstration projects have Jollow-up systems built in at 1 

^three- and eight-month mtervals. It i^very expensive/as you know. Within the regular CETA system 
the follow-up is not vfery long. 1 believe it is at thirty-, sikty-, and ninely-day intervals, and softe prime 
sponsors have much more extensivakinds of follow-up arrangements than others depending or) the 
extent .of the evaluatton efforts. Follow/up is not one of our gr^t strengths^ and at least for the 
research portions, w£re doing as much as we can in this area. Thfen, we have the^lbngitudinal work 
whifh will be tracking participants in a whole range of programs over a number of year^. I don't know 
If It has been determmeti-yet how many y^ears if will go, but that, too, will be the longest-term follovy/-UD 

. that we will have had on a^y of the intervention programs. . , \ N : .-^ 



'Question: Are there any initiatives comingioutW the Department of Ljbor that would lead to a 
' ■ ^ cooperative effort on the part of DOL and vocational education in-working with . 
secondary school Vouth, speGifically in the area of em^oyability? * 

• ■ - ' ■ i ■. ^- ; 

From the pepartm'ent of l^abor perspective, as opposed to the perspective of HEW, one way we v 
are fostering that cooperation is by recognizing that employment and education are inexorably inter- * 
twined-you cannot become a fully functioning adult in our society without adequate educational 
preparation. From that perspective, vye in the Department of Labor are fuHyTTfveAved in education. 
In our programs the objective is to: make people not only employable, but to help them obtain employ- 
ment. We want to take 'them that next step to employment, not just employability. The emphasis is 
on placement, on getting people intp>the labor market-if.need be, in a subsidized way, but employ- 
ment is our main ob^ctive. That doesn't mean we disregard postsecondary training but, again, for the 
purpose "ultimately of employment rather than self-enhancement or other goals. We justify everything . 
we do in terms of employment. r [,\ 

■ Specifically with vocational education, we're dgin^ a whole^series of things. Within thb last 
couple ©f weeks HEW announced fourteen jd^iTp^^^^^ with DOL selected in response to national 
cdnipetkion o?^ vocational educatjon/CE A.^request for proposals went out to the vocational 

education system asking for proposals in conjunctiorf..vvith GETA. Areas of concern.are curriculum, 
staff development, and anything related to bringing t|ie two systems together. The focus could be ' 
administrative or direct program kinds of things. Thpse obviousf^have not started, but in the mean- . 
• time, under the exemplary inschool program,.we have all kinds of variations on existing and experi- ' 
mental vocational education^activitie^. Again, we Igave curriculum sharfng tying in with cooperative 
education programVand joint placement; job deverapment kinds of activities; and utilization of staff, 
resources, and equipment in many sites. We have a demonstration projjBct run through fIpSE, the Fund 
for the Improvement of Post-Secondary Education, exploring^a range of postsecondary activities • 
located mainly in vocational-technical schools but also in certain community colleges involved in 
postsecondary vocational training! A series of projects was funded last summer to;provide a more r , 
career-oriented f ocas to Upward Bound and to provide summer employment related to the vocational 
focuses of the Upward Bound program. Both work experience during the summer and training related ' 



to that wefre incGrporated into a separate multiyear Upward Bound^type of program. Another project 
involving a number of predominantly black colleges, focused on CETA/vocatlonal education in 
summer programs. If we gave mo^ney for'summer programs to postsecondary institutions, we wanted' 
to see what kind of an enhanced summer component that would bring about. These are only a few of 
the many efforts in this.area. ' ^ . . 

■ ' ■ . ■ * , . ' * 

Question: Do you f bqI these pi/ograms are more apprbpciate for the postsecondary rather thart 
• ■ secondaryievel? ^ « • 

lam not going to give my opinion on that "because I don't have a "y,es-or-no" answer to your • 
question. I think each program has to be judged on its own merits. Much of the literature points'out 
that there IS a differential between what is taking place at the secgndary level versus the postsecondar 
evel. There are those .who diaim that th6 most effective skill training takes place at the postsecondary 
level. I would siqnply take this as an indication that people are beginning to recognize that there are- 
stages at which youth do better in different kinds.of activities and are ready-^to participate in different 
kinds of programs. There is tremendous disagreement about that, and my own opinion is that we need 
much mored regEarch"in th|^area before we can make definite, supportable statements. 

y . ^ . . \ ^ . , ^ " . . » 

Question: You made some intere5,ting comments about the:characteristics of success (or la^ ' ' 
t+iereof) in school programs. Can you expand on that? Do you have any more prelimi- 
nary assessments from thestudies you did?. ■• ~ . 

First of all, everything we have is anecdotal-samples, samples, samples-it is all anecdotal from 
site visits and from going to endless meetings. Tj^e Office of Career Education sponsored twenty-two 
miniconferences and ten regional meetings. Basically, wR^t | have learned is that as people Started 
working together, they started trusting each other. They \S|ere able to come^ some kind of agreement 
on what the level of program should be and how it should^e focusell. As that happened, relationships 
got better and, consequently, progf-ams t^n more smoothly. , ^ 

The Great City Schools report goes fnto quite a discussion about staffing. For instance, they 
found that it makes a tremendous difference whether^he CETA program is operated through the 
vocational education people vvithin the school or others-for the most part those "others" probably 
would.be the career education people, but then again, not in all cases. Out of 16,000 LEAsor'460 
prime sponsors, we don't know exactly who, in tact, is doing all of this. We are in the.process of 
sending a report to Congre^. The map I'm working with frofm HEW keeps sayirig, ''How many of 
this?" and "How many ofuhat?'' The answer is, nobody knows, but we do know'that there is a 
^^^endous difference in tfrograms depending upon whether the vocational education people or the 
^^er education people ar6 running thenri. If the,program is run by vocational education people, it 

.will be more focused on skill training as opposed to career exploration or career centers. It will ' 
probably dea^l with the higher-level, more advanced student than tjie other kinds of programs. 

^ . - ■ . • ■ . ■ * ■ 

There is a tremendous variation in agreement in local school districts on what the role of the 
CBO should be. In s9me ^ces, the CBO by choice of-the school system and the prime sponsor is 
basically operating most of^he inschool programs. They have had very successful experiences under 
NYCtStarting several years ago. In some places, they still call it NYC, although it is something totally 
different at that point, in other places they all hate each other andthey don't want to talk together. 
And then, depending on the personal relationships involx/ed, differen^inds of things develop. This 
is the flavor of what I have been picking up in my conversations and meetings. CONSERVA has not 

'even come out with its analytical piece yet. All they have at this point is a huge book of models, but 



apin^ one of the things they are saying is that in many cases the coordjnBtion has not mov^d beyond 
administration-. There is really no integration of program. In"^any cases we find a CETA program " 
stuck somewhere within the schoof building because enrollrVient wsfsn't great enough to warrant 
placing it in the vocational-|echnical center. So the program is.bemg operated through the school, 
• yet in many casfes'the CBO pays the checks because the school's computer system wouTd breakdown 
if it had to deal with check-writing..So often those^kinds of oonphijosophical issues are really the key - 
to how vocational education and CETA ore^working together-whether a computer system can handle 
checks, whether tRe personalities involved are compatible, wliether the physical plant set-up fosters, 
cooperation, * ^ . 

We have found that if the school'f eels an ownership for and feels it has contrgl^over the CEp\ 
prograjn, it tends to be more accepted within the school. The academic credit provisions are very much 
_a part of tl^t. If the schools agree to grant credit iot theip CETA program^ then they start worrying . 
^about it, ltW;omes something the principarhas to report on and Idc responsible.fbrraVid if the principal 
is responsible far it, he or she will p^y attention toJt and give it a*decent room. One of the reports 
said the C^A.staff person was hired as CgacKof th^asketbgllVe^rr. and this was a major bregkfhrough. 
That's the kind of tWng I mean. Thave^npt seen any evidence anywhere to prove thatone program ^ 
model is better than another. So many kind5_Qf "extraneous" things are involved that it is hard to pin 
success 0/ failure to wheth&r :tfie program' meets four hours five times a vveek ol* focuses on this varia- 
}:ioj>dr that. Jhose areall the kinds of things tha'E' we're testing how, and whether the mor^qcessful 
programs co.ncegtrate jpn- more c'areer information or more iskill trailing or fnore outside-of ^school 
activities,^we dorVi know. ^ <^ 

. / ■ . ■ ■ :»;.,■■ ^ . ^ 

XJuestion: Do you see the CETA program as an a/femaf/i/e or a coA?7p/^^ ^ [ 

school vocational program? Are we perhaps in danger o'f creating a new systerT) of ^ 3 
segregation by, in effect, channeling the economically disadvantaged into a separate 
systeln? . . ' ' ■' ' ' ■ / 

The Department bf Labor has recommended and is now going througH this whole o^cy review - 
. process which includes an examination of just such issues. The president of the United Stices will say 
something in the State of the Union message on what^he youth initiative will be,.Appargbtly the 
only domeslfic initiative Will be youth employment. He will say that the federal government wants to , 
get out of the education business, but in fact, we are in the education business. The Jojp Corps is the-^ 
largest alternative education^program' there is. But we are funding many kinds of programs that school . 
■ systems now cannot afford. Federally-funded programs provide lower student/teacher ratios, more 
intensive follow-up, and all k^inds of service links to other community agencies that schools ju^t cannot 
provide. So, in fact, we are creating a capability within the schools that did not exist before, 

• ■ ■[ ' ■ ■ ■ ' ; ■ ■ ^ . ' • 

What we and HEW both have proposed is that more money be put down the education side 
through ESEA or similar programs to provide mo^e targeted use of those funds. The problem is that 
our legislation is a speciallpurpose legislation geared for a special population, and that is what we 
have to focus on. That does not mean that all youth don't need much more in the way. of awareness - 
of the world 6f work and introduction to that through' experiential types of opportunities. Many, 
rp^y kids want to take part in alternative kinds of programs,6ut they don't have access to them/ 
That is a real problem) and that's what I'm talking about. 

Can a targeted Rrhd of program bring about change in schools? When I was in Baltimore a few ' , 
weeks ago, I was told :that^there is a two-year waiting list to get into the CETA-funded alternative ' 
education program. So I asked, "Why don't you create more of them?" That seemed to me an ; 
obvious solution since they had told mefor half an hour^ that CETA programs weren't really nibre 
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expensive when conapared-tp some of the alternatives. When so many kids want to get into a certain 
kind of program and are dropping od^of another kind, it should be telling the school officials's.ome- 
thing. I thinl< CETA shoulc^end up being a work-oriented cbmpleinent to what takes place in schools; 
There should be'some target!^ on special populations, but it should nofjestablish a whole^lternatjve 
education system. Of cour^s^e cjp^uld end up with three basic trar ;-acaderflic, vpcationel, and 
third-class GE'&/\. That is a possibility. We need to start integratin . I of these and providing a whole 
range of alternatives. For one specific population; these activities iic:-^ be funded throL^h^ but 
we are the only ones who have the money and the discretionary f/j -nr. ty to try to bring about the - 
necessary changes that \o/e'hope will en^ up benefitiog everyone 



We end. up fighting^ a lot of the battles/that aren't ours. Th 
Department of Labor issuerThe law, the regulations, everythir 
the state law or the prevailirigjocdl education policy should be Ic 
experiential learning ^nd hovTone grants credit and sdts standa 
meht of Labor when it is a real problem shared by all educatioi 
wedge— we Jeel that real learning takes place in certain program 
these programs should getlome kind of credit for taking this traii. 
the credjt.shoui:d be. Yet because of the money and all of the activit 
educators are payihg special atfSntion to what we are doing. Now tr 
about change through these activities. What the implications are for 

but I thinkjfhey are important, and I think the schools are going to cr-^rt addressing these issues. If 
they don't, they will lose control ovfer them. v . ■ ^2 ^ ■ - 



academic credit issue is not a 
'Written has specified that 
> The whole battle over 
^.nig attributed to the Deparf- \ 
A agericies. But we're the - . 
ons, and we thjnk tife kids in. 
but we're not dictating whaJK ^ 
in this area, all of a sudden ^ 
t'is good- because we are bringing 
total system, I don't know; 



Question:^ 

- V 



So far, you've talked about career developnrTent in terms of '^M) satisfaction"— that is, 
finding/the work itself stjitable or rewarding.' How do you deal with the typical 
^nentality that views a job solely as a means of maintaining a* certain lifestyle? ^ 



^ ^ On^of the things we try to teach kids is that if you are a high'^ch^ol dropout who can't read 
and write you're not going to. be able to support a very grand lifestyle.^ That is a very imf)ort 
lesson, which many kids don't recognize. So^e tell them: if you want a decent job, you'd better 
make some arrangements— get an.edudation(fget some training, get into.one of the not-so-fulf illing 
jobs that you can usd^as your entry into tKe job world, ar^ get yourself sqrae work experience so^. < 
thaf you- have some kind of credential to bring to the next employer. Weify to impress on them that 
the values of our society still control the gates to employment, and if you want to have access to *" ^ 
employment, you're going to have to behave in certain ways, We don't try to restructure society 
through this program; we try to help these kids get into the world of work however^ it is at the 
moment. Of course, we're working with' the employers to get them to proyide support and a.more 
open environment, but it's a two-way street. We tell these kids they have got to apply themselves, 
they hava5[pr to have some kind of training, some kind of education, and they havei^of to show up 
on the job-rori time— and ngt talk back to the supervisor. They Have ^^of. to do all these things if they 
expect, within the legitimate system, to have a decent lifestyle. • 

■ ■ ■ .'."^^ ■ / '■ ^ . ■.. V ; . ■ ■ ' , ■ . ■ •• > ; . 

' ' , \ spoke to several kids.Vwho went through a vocational exploration program a couple pf summers, 
ago and they told me things lil^e, "I really^wish I had had this experience earlier in high school 
because I saw that I realjV/doh't wantto do this kind of yvork." Aror- sr said, "Vou know, I thought 
it would be nice to wqijk in the ballbearing factory, bj^ it's real y a " ..Ir I couldn't do that for the 
rest of myjife. I re*ally shciuld have taken math so that I could get :: vocational training coucges, 
but now it's too \^^^^'^^^$y eyen'jf kids recognize that their horir —3 have to be more limited, 
this represents sorfreT^f^hess' Through these -^jt^eriences -they real : 
•^that if they really want to c[et somewhere, th^ have to start maKir 

• . / ' 



:hat success is ^ot automatic, 
1 effort. We tell each one. 
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^ cnlhlt """""^ ^° '"'^^V *° ^'^^ some f/oi^e>5perience, whether it's subsidized o'r created' - 
• '^t" ^T' that ytu can work, that y^,^n move ahead and apply Vourself." But that ' 

untn thW do °' '''' '^^^^^ simply haye to work with them 

'Question: Can you give us some idea of the extent of community irjvolvement^^ 

' .programs? VVhat impact does such community involvemeTit have? . . ^ 



's c community-based 
'<inds of support 
'i coaching and 
f the Hispanic ' 

hool as well' as trying 



We have no definite findi- as yet, but we are working witfi a whole ser 
organizations in a project callr- nool-to-yVork Transition. We have work- 
programs during lunch-hours .aks. There's also a program after scho , 
remedial kinds of help. We ar. a) i to provide various kinds of support Sc 

groups ar^9 working with- Kispanic Js trying to mqke them fe&l a parV)T'the..nooi as weic as trying 
un t^ZTTt-tr '^'-''''^'t^ P^?'^"^^ Hispanic girl? tend to^iave. They have been brought 

- h^Jn orol t '"I'P""' °^ doing-certain things. One of the rec strengths of the commun ty- 

based orgarnizations is that they can provide the kind of Coaching support general help remediaZn 
and group J^unselmg kinds Activities that the schools cannot provide. - or instance in eTtimore 
the programVstructured so'trat Friday afternoon is a rap ses.ioh where .,ds out on day jobs Tan 
come back and talk about the! r experiences.^ trairjed^ouns^lor helps r- ^ to turn these sessions 
mto a positive kind of learning experience. Tf/e kidTalso provide mu?ua upport to each o he °n a 
very focused'way. These kids experience the same types^of problems an: ancoum^r the same kinds of 

,,b.as6s. so they have a goDd basis f6r r^yftual sharing and 'support. We're do no amf r s^^^^^^^^ 

' tS 't? '"^''^"J ""'^ ■ -i''^'"^ °" of :community-base5Wzations^d !ying 

these together into the most effective pStSsible program. V. » 



Question: 



■If your basic purpose is totjiake yc^ur cfients employable, aren't the percentage fwures 
on those who have reachedAhls goal djscouragingly low? What do'you see af the maior 
problems? * . » ' 



• ^ Ideally cari't tell you. Again, we,are I um'ping together different kinds of things. Until we 1 
concentratey iDn the Youth Programs, we hgd aU kit^ds of categorifeal proc-ams. kford 1973 we had 

. MDTA and all the Economic Opportunity Progranis. Theii we were consolidated into a decategoVjzed 
program called CETA,.and everything was lumped/into wh&t was^tKen Tftle I, which endonipassed 
eyerythmg frpm workirig.with really young kids ifi'career exploration-, to high-level skill trainwg to ' 
wprjciag with adeilts. Ifwas all lumpedtogejher Wjth no differentiation until, intensive efforts with 

.;t,he Youth Program tq differentiate it gave us twd/totally different processes. One is what we're ■ 
doing with, ernployabil^^developmeht where thb immediate goal is not placement as it. would be 
.with people who are-n^firmore job-ready. The/4 are different measures which musjt be applied to' 
that kiijd pf prpgraqp^ccps^ might mean niov/hg a cli^t from A to B \' len the ultimate goll is D 

, but fop a fifteen-ye&r^d;after four months, tH6 goal is. not D-^^^ f . . 

to- school. For that individaal you know D vvill'liave to come three yea 
under an entirely different understanding oivh.^t the objectives of the 

'■kthat we must develop a different measurement system. We have never 

■ the incremental changes because the only measure we had was placem 
prpbably 50 percent of the population we were dealing with were yoi 
not an immediately obtainable outcome. So we found we had been m 
that doesn't mean we shouldn't be doing better in placement. Obviousl . 
respond with definitefigures at this'time. '. 



0 re :urn .that youngster 
r -Q we are operating 
are. ltfollows,.th'en, 
0 measure any of 
-: job when, in fact, 
~ i or Whom that was 
e wrong things..-Now 
ould, but I just can't 
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Question: ;0f the sevdy-al units involved in CETA prog'raPhming (e.g., the schopi, business/industry, 
' and governmental units), from ^ practitioner's standpoint, vvhere d^ 
major problems occur? - / , / 

^ 'You must remember that the implementation of CETA programs varies frpm place tc nlace. We 
have some horrible prime sponsors and school'systems where people are. not doing much, ^hen we 
have just the opposite. I don't think you can make standard judgmerits across the board, jneof the 
findings that came out is that among the programs that qualify by population, the lyikage is offen * < 
a lot better bemuse it is the same governmental institution that is running both the schobi system 
and the, CETA program; In a place where the mayor has controj over'the school board, he or she^is' ^ 
able to c^ll all those peop\e together arid say, "You M//7/^work together and you will do it effectively." 
In tl]ese situations, it is bound to work. In palces where the politicat process keeps these etements 
apart, where some people are county employees and sfOm« report to the school board, it is much niore 
difficult. They have different critena to relate to for evaluatipn)H{rposes and it's hard to get agree- 
ment. I don't think you can cast bTame on anyone. Who does what>differ$ in different places. In some 
places, pr>ime sponsors -run their own programs, and in some, all th^y^jo is rtianage and fund everyone 
else. In some places, there is no suq|3 thing as a CET^A program. CETA merely provides the money that 
pays for all the other deliverers. And then people ask, is CEtA good or. bad? Is the CETA program 
funded thrpugh yocationaT education bfetter or worse than the ot?ier programs? 4t is simply impassible 
to give a conclcisive^answer. ' ' 
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